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Confederation  Load  Test  Plan 


Management  -  The  execution  of  the  Confederation  Load  Test  will  be  directed  by  the 
officer  staffing  the  ECF  Control  Desk  (Capt  Adams).  All  instructions  regarding  model 
operations  will  be  issued  by  that  officer.  Mr.  Emert  will  be  responsible  for  tracking  and 
directing  the  progress  of  the  Test  Plan.  He  will  be  located  in  the  ECF  using  the  Control 
Desk  to  initiate  the  steps  of  the  plan  and  AOC  reports  and  software  tools  to  deteimine  the 
completion  of  the  steps.  The  Operational  Test  Director  (LTC  Taylor)  will  coordinate^  all 
AOC  activities.  The  ECF  Control  Desk  will  inform  him  of  the  beginning  of  each  step  of 
the  test  plan  and  he  will  in  turn  direct  the  appropriate  AOC  personnel.  The  Operational 
Test  Director  is  responsible  for  reporting  the  status  of  his  assigned  tasks  back  to  the  ECF 
Control  Desk.  The  Technical  Test  Director  (Dr.  Weatherly)  is  the  final  authority  on  all 
Load  Test  questions. 

Part  I  -  Rank  Ordering  of  Effects 

Goal  Achieved:  Part  I  will  enable  us  to  identify,  within  CBS,  the  load  parameters 

that  have  the  greatest  effect  on  game  ratio.  The  methodology  should  enable  us  to  rank 
order  each  parameter. 

The  game  ratio  should  be  set  to  run  as  fast  as  possible  (6:1).  Though  it  is  expected,  it  is 
not  required  that  the  confederation  achieves  a  ratio  of  at  least  1:1. 

ALSP  logging  (Actor-ACM,  ABE)  should  be  OFF  for  the  entire  length  of  part  L 

The  CIF  files  from  part  I  will  be  kept  and  used  in  preparartion 


1)  Prep  time  /  RESA,  AWSIM,  launch  aircraft 

-  ADA  units  on  hold 

-  7,000  units 

2)  Run  with  steady  activity  for  data  collection 

3)  Turn  ON  ADA  units 

4)  Take  a  confederation  save 

5)  Run  with  steady  activity  for  data  collection 

6)  Build  to  200  Artillery  missions 

7)  Run  with  steady  activity  for  data  collection 

8)  Restore  to  save  (taken  at  step  4) 

9)  Build  to  60  HELO  missions 

10)  Run  with  steady  activity  for  data  collection 

11)  Restore  to  save  (taken  at  step  4) 

12)  Build  to  50  Convoys 

13)  Run  with  steady  activity  for  data  collection 

14)  Restore  to  save  (taken  at  step  4) 

15)  Build  to  250  Infiltrations  /  25  COAST  missions 

16)  Run  with  steady  activity  for  data  collection 

17)  Restore  to  save  (taken  at  step  4) 

18)  Build  to  100  Combat  Sets 

19)  Run  with  steady  activity  for  data  collection 

20)  Periods  of  downtime  (eg.  crashes)  /  Troubleshooting  2  hours 


for  part  II. 
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15  minutes 
10  minutes 
5  minutes 
15  minutes 
30  minutes 
15  minutes 
10  minutes 
30  minutes 
15  minutes 
10  minutes 
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15  minutes 
10  minutes 
1  hour 
30  minutes 
10  minutes 
1-2  hours 
15  minutes 
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Total  Time  Part  I: 


IQ- 11  hour;? 


When  each  of  the  primary  steps  are  completed  (1,  3,  6, 9,  12,  15  and  1 8)  the  exercise 
control  desk  should  be  notified  so  that  all  test  participants  are  aware  of  this,  and  can  take 
the  necessary  steps  for  data  collection,  logging  of  events,  etc.  The  exercise  control  desk 
mil  enter  ^y  significant  activity  (eg.  model  crashes)  that  occurs  within  the  confederation 
into  an  on-lme  log. 

Verification  of  the  totals  in  steps  6, 9, 12, 15„  and  18  will  be  from: 

-  CBS  UXREF  files  and  workstation  calculations  (SHOWDB) 
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Part  n  -  Typical  Expected  Loads  (TEL)  =>  See  Appendix  A 

Goal  Achieved:  Part  n  must  verify  that  the  confederation  will  be  able  to  maintain  a 

1:1  game  ratio  at  typical  expected  loads  for  '94  exercises.  This  is  the  primary  goal  of  the 
load  test. 

The  game  ratio  should  be  set  to  run  as  fast  as  possible  (6:1).  Any  ratio  of  1:1  or  better 
will  be  considered  successful. 

ALSP  logging  will  be  toggled  ON/OFF  during  the  collection  period  (step  6,  part  II)  to  see 
the  effect  that  logging  has  on  game  ratio. 

While  running  at  TEL,  an  additional  confederation  save  will  be  taken  when  it  appears  that 
the  peak  load  (objects  and  interactions)  has  been  reached.  This  confederation  save  will 
be  used  as  the  starting  point  for  part  HI. 


lims 

1)  Restore  from  part  I,  step  4  save  10  minutes 

2)  Build  to  100%  of  TEL  30  minutes 

-  by  stuffing  GIF  files,  generated  from  part  I,  into  CBS 

-  in  RESA  and  AWSIM  (in  parallel  witii  CBS) ,  launch  aircraft  and  produce 
interactions  approximating  the  typical  expected  load  for  the  '94  confederation 


Verification  of  this  total  will  be  from: 

-  CBS  UXREF  files  and  workstation  calculations  (SHOWDB) 

-  Object  counts  seen  at  the  ALSP  Actor  Monitor  Screens 


3)  Take  a  confederation  save  at  50%  of  TEL 

4)  Take  a  confederation  save  at  75%  of  TEL 

5)  Take  a  confederation  save  at  100%  of  TEL 

6)  Run  at  100%  of  TEL 

7)  Take  a  confederation  save  at  peak  load  of  TEL 


5  minutes 
5  minutes 
5  minutes 
1  hour  30  minutes 
5  minutes 


8)  Periods  of  downtime  /  Troubleshooting 


2  hours 


Total  Time  Part  11: 


4  hours  30  minutes 


Contingency  plans  for  part  11: 

A)  If  unable  to  maintain  a  1:1  game  ratio  at  TEL: 

1)  Drop  back  to  50%  of  TEL 

2)  Run  at  50%  TEL  until  1:1  is  achieved 

B)  If  successful  at  50%  TEL: 

1)  Build  to  75%  of  TEL 

2)  Run  at  75%  TEL  until  1:1  is  achieved 

C)  If  successful  at  75%  TEL: 

1)  Build  to  100%  of  TEL 

2)  Run  at  100%  TEL  until  1:1  is  achieved 


3 


Part  ni  -  Maximum  Expected  Loads  (MEL)  =>  See  Appendix  B 

Goal  Achieved:  Part  HI  will  test  the  confederation's  ability  to  maintain  a  1:1  game 

ratio  at  maximum  expected  loads  for  '94  exercises. 

Part  in  will  not  be  started  until  part  II  is  successfiilly  completed.  The  game  ratio  should 
be  set  to  run  as  fast  as  possible  (6:1).  Any  ratio  at  1:1  or  better  will  be  considered 
successful. 

The  gradual  build-up  of  parts  HI  and  IV  will  better  enable  us  to  identify  the  approximate 
point  at  which  the  '94  confederation  may  fail  to  run  at  1:1 

While  ranning  at  MEL,  an  additional  confederation  save  will  be  taken  when  it  appears 
that  the  peak  load  (objects  and  interactions)  has  been  reached.  This  confederation  save 
will  be  used  as  the  starting  point  for  part  FV. 

Verification  of  the  totals  below  (steps  3,6,9,12)  will  be  from: 

-  CBS  UXREF  files  and  workstation  osculations  (SHOWDB) 

-  Object  counts  seen  at  the  ALSP  Actor  Monitor  Screens 


1)  Restore  from  save  (TEL),  Reload  CBS  database  to  reach 
1 1,000  units,  perform  necessary  splitting  of  ADA  units 

2)  Take  a  confederation  save 

3)  Add  25%  to  TEL 

4)  Take  a  confederation  save 

5)  Run  at  25%  +  TEL 

6)  Add  50%  to  TEL 

7)  Take  a  confederation  save 

8)  Run  at  50%+ TEL 

9)  Add  75%  to  TEL 

10)  Take  a  confederation  save 

11)  Run  at  75%+ TEL 

12)  Add  100%  to  TEL  =  MEL 

13)  Take  a  confederation  save 

14)  Run  at  MEL 

15)  Take  a  confederation  save  at  peak  load  of  MEL 


Iim.s 

30  minutes 

5  minutes 
30  minutes 
5  minutes 
20  minutes 
30  minutes 
5  minutes 
20  minutes 
30  minutes 
5  minutes 
20  minutes 
30  minutes 
5  minutes 
1  hour 
5  minutes 


16)  Periods  of  downtime  /  Troubleshooting  2  hours 

Total  Time  Part  III:  7  hours 


Contingency  plans  for  part  IE: 

A)  If  in  part  H,  a  2: 1  game  ratio  or  better  was  achieved  at  TEL: 

-  if  the  ratio  is  still  better  than  1:1  at  steps  5  and  8,  skip  these  steps  while 
proceeding  to  step  9 

-  then  increase  the  data  collection  period  to  30  minutes  (step  1 1) 


B)  If  contingency  A  is  used  and  the  game  ratio  is  still  1 : 1  or  better,  proceed  with  the 
remaining  steps  until  MEL  is  reached 


Else 


4 


C)  If  contingency  A  is  used  and  the  game  ratio  is  NOT  1:1  or  better,  drop  back  to  the  step 
4  save  and  run  at  this  level  until  1:1  is  achieved.  Then  proceed  in  25%  increments. 
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Part  rV  -  Ultimate  Notional  Confederation  Load  Experiment  (UNCLE)  ==>  See 
Appendix  C 

Goal  Achieved:  Part  IV  will  give  us  a  benchmark  for  future  confederations  at 

ultimate  notional  confederation  loads.  It  is  only  an  experiment. 

We  do  not  expect  that  the  confederation  will  be  able  to  achieve  a  1:1  ratio  at  these  loads. 
No  specific  ratio  goals  are  required  to  achieve  confederation  certification  from  part  FV. 


1)  Restore  from  save  (MEL),  Reload  CBS  database  to  reach 

Time 

40  minutes 

15,000  units,  perform  necessary  splitting  of  ADA  units 

2)  Add  25%  to  MEL 

30  minutes 

3)  Take  a  confederation  save 

10  minutes 

4)  Run  at  25%+ MEL 

20  minutes 

5)  Add  50%  to  MEL 

30  minutes 

6)  Take  a  confederation  save 

10  minutes 

7)  Run  at  50%  +  MEL 

20  minutes 

8)  Add  75%  to  MEL 

30  minutes 

9)  Take  a  confederation  save 

10  minutes 

10)  Run  at  75%+ MEL 

20  minutes 

11)  Add  100%  to  MEL  =  UNCLE 

30  minutes 

12)  Take  a  confederation  save 

10  minutes 

13)  Run  at  UNCLE 

1  hour 

14)  Take  a  confederation  save 

10  minutes 

15)  Periods  of  downtime  /  Troubleshooting 

2  hours 

Total  Time  Part  IV: 

7-haPts  2.Q  jmutgj 

Total  Time  all  4  Parts:  29-30  hours 
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APPENDIX  A 
Performance  Targets 


CBS  Confederation-related  Performance  Targets 


Parameter 

TET 

—  iriirni 

75%  of  TEL 

5,250 

miiiSiSsMsmmm 

225 

Ghosted  Air  Msns 

200 

■■■■■■ESSi 

CBS  Model-specific  Performance  Targets 


Parameter 

TEL 

50%  of  TEL 

75%  of  TEL 

Arty  Missions 

150 

HELO  Missions 

45 

Convoys 

25 

37 

Infiltrations 

125 

187 

Aircraft 

225 

Combat  Sets 

501 

25 

37 

COAST  Missions 

25 

12 

19 

AWSIM  Perfromance  Targets 


Parameter 

TELI 

mmsmMsm 

Air  Missions 

■■■■■■E^ 

225 

HIMAD/ALLRAD 

90 

45 

67 

RESA  Performance  Targets 


Parameter 


Boats 


Aircraft  Flights 


CMs/TBMs 


Helicopters 


Submarines 


Radars  (active) 


Sonobuoy  Fields 


Total  RESA  Units 


ALSP  ghosted  units 


Total  units  in  DB 


APPENDIX  B 


Performance  Targets 


CBS  Confederation-related  Performance  Targets 


Parameter 

MEL 

—TfTim 

Units 

11, (XX) 

10,000 

SHORAD  Units 

450 

337 

375 

412 

Ghosted  Air  Msns 

500 

425. 

450 

475 

CBS  Model-specific  Performance  Targets 


Parameter 

MEL 

TTniirri 

TEL  +  50% 

TEL +  75% 

Arty  Missions 

400 

250 

300 

350 

HELO  Missions 

120 

75 

90 

105 

(ionvoys 

100 

62 

75 

87 

Infiltrations 

500 

312 

375 

437 

Aircraft 

500 

350 

450 

Combat  Sets 

100 

62 

75 

87 

(^lOAST  Missions 

50 

31 

37 

44 

AWSIM  Perfroraance  Targets 


Parameter 

MEET 

TEL +  50% 

Ml  fTlftil 

Air  Missions 

500 

350 

400 

450 

HIMAD/ALLRAD 

no 

95 

100 

105 

RESA  Performance  Targets 


Parameter 

MEL 

tEL  +  25% 

Miiniw  ■inEM 

i  TEL  +  75% 

325 

325 

325 

325 

Boats 

250 

175 

200 

225 

175 

119 

138 

156 

CMS  /  TBMs 

35 

40 

45 

Bases 

50 

50 

50 

50 

Helicopters 

15 

11 

12 

14 

Submarines 

100 

100 

100 

100 

Torpedoes 

15 

11 

12 

14 

Radars  (active) 

650 

462 

525 

587 

Sonobuoy  Fields 

12 

15 

17 

Total  RESA  Units 

950  1 

762 

825 

887 

ALSP  ghosted  units 

500 

350 

400 

450 

Total  units  in  DB 

1,450 

1,112 

1,225 

1,337 
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APPENDIX  C 


Performance  Targets 

CBS  Confederation-related  Performance  Targets 


1  Parameter 

UNCLE 

Til  illP%l  li^ 

MEL +  75% 

15,000 

12,000 

13,000 

14,000 

SHORAD  Units 

600 

487 

525 

562 

Ghosted  Air  Msns 

700 

550 

600 

650 

CBS  Model-specific  Perfonnance  Targets 


AWSIM  Perffomance  Targets 


Parameter 

Mel  +  50% 

Bi  t  i  ilMPVin  ■ 

Air  Missions 

550 

HIMAD/ALLRAD 

130 

115 

120 

125 

RESA  Performance  Targets 


Parameter 


S 


Boats 


Aircraft  Rights 


CMs/TBMs 


Bases 


Helicopters 


Submarines 


_ Radars  (active) 


Sonobuoy  Fields 


Total  RESA  Units 


ALSP  ghosted  units 


Total  units  in  DB 
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